Levy Processes on a First Order Model |j 

Siu-Ah Ng 

University of KwaZulu-Natal, South Africa 

The classical notion of Levy process is generalized to one that takes as 
its values probabilities on a first order model equipped with a commuta- 
tive semigroup. This is achieved by applying a convolution product on 
definable probabilities and the infinite divisibility with respect to it. 

Key WORDS: First order model, independence property, Levy process, 
infinite divisibility, convolution, semigroup, Loeb measure, nonstandard 
analysis. 

Mathematics Subject Classification: 03C99, 03H05, 60G51 



1. Introduction 

In a first order model 2t — {A, . . . ), an element a <E A is identifiable with its 
type in the diagram language Ca- As a type, a corresponds to a {0, l}-probability 
measure on the Boolean algebra of CA-iorumlas having only one free variable. In 
this respect, elements in A are regarded as deterministic. Then an arbitrary prob- 
ability measure on the Boolean algebra corresponds to the law of a certain random 
variable — both the law and the random variable are liberally identified with each 
other. So intuitively one treats the collection of these probabilities as random "el- 
ements" of A and a time evolution of these probabilities as a stochastic process on 
21. 

In classical stochastic analysis. Levy processes are stochastic processes with sta- 
tionary independent increments. Prominent examples from this important and 
well-studied class of processes include Brownian motions and Poisson processes. A 
fundamental characterization of this class is that the laws of these processes satisfy 
some infinitely divisible condition. 

The theme of this article is to explore a way to define Levy processes on first 
order models as closely analogous to the classical real- valued Levy processes as pos- 
sible. To achieve this, we need to borrow Keisler's notion of probability measure 
on a model and nonforking product from 5J and rely heavily on results from that 
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article. However, in contrast to [5], we will neither deal with forking nor delicate 
extensions on larger fragments. In order to specify a convolution product of two de- 
finable probabilities, we require that a commutative semigroup be definable. Then 
the remaining task is to identify definable probabilities which are infinitely divisible 
w.r.t. the convolution product and to define Levy processes w.r.t. either a discrete 
or a continuous timeline. In either case, the dynamics behind the evolution is deter- 
mined by the definable semigroup. In fact, given an infinitely divisible probability 
/I, the corresponding Levy process is a time evolution from 0, a special element in 
A, to ^. When 21 is the real ordered field (M, +, •, <, 0, 1), everything here coincides 
with the classical real- valued Levy processes. 

Comparing with Keisler's work |6J on randomization of a first order model, here 
we only deal with objects closely connected to 21 and will not involve an external 
probability space. Consequently, instead of random variables, we work purely with 
probabilities on 21. Moreover, our measure algebra already has enough saturation 
built into it, hence we are able to avoid technicalities such as finite additivity 
vs. cr-additivity and liftings vs. standard parts. Obviously, since we are moving 
away from the classical stochastic setting, a lot of analytic tools such as Fourier 
transforms have to be given up. One needs to find algebraic, model-theoretic and 
combinatorial replacements in order to obtain useful results. 

Other equivalent formulations of our Levy processes should be possible. For ex- 
ample, by defining hyperfinite random walks on 21 or by starting from nonstandard 
compound Poisson processes. But we will not take such routes here. Interestingly, 
it is unclear at this point what corresponds to a Brownian motion, the prototype of 
Levy processes, on a general 21. For further investigation, perhaps one should also 
study Markov processes on some first order models. 

We first introduce our notation and terminologies in the next section. The role 
of Borel functions is played by definability in our context. The details are given 
in [J3l In 21 infinitely divisible probabilities and Levy processes are developed. 
In our context, a Levy process can be regarded as an evolution along a "straight 
line segment of probabilities" from a fixed deterministic element to a fixed infin- 
itely divisible definable probability. The process is indexed by various types of 
timelines, discrete or continuous. In order to define continuous time indexed Levy 
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processes, convolution exponentials are introduced and the Levy-Kliintchine prop- 
erty is formulated. A class of Loeb measures constructed from internally definable 
probabilities is required and Levy processes for these probabilities are also investi- 
gated. 



Some familiarity with model theory, stochastic analysis and nonstandard analysis 
is assumed. The latter is only needed for the Loeb measure construction to get 
cr-additive probability measures. Notation, definitions and basic results from [4], 
[2] and [TT] are freely used throughout. 

The real closed ordered field (R, •, <, 0, 1) is denoted by £H. 

We work with a fixed first order language L and an £-model 2t = {A,...). 
Moreover, either we require that L be countable, as in [5|, or we we allow \L\ be 
arbitrary but require Th(2l), i.e. the theory of 2t, do not have the independence 
property. Under the absence of the independence property, by the Corollary in [S] , 
results from ^ for measures on 21 remain valid. 

Furthermore, we assume that a commutative semigroup structure is definable in 
21. That is, there is an >C-formula 0{x,y, z) such that 21 satisfies the following: 



[ 3x'iy0{x,y,y). 

For example, if 21 defines a poset in which there is a least element and any two 
elements have a unique least upper bound then we can take 6{x,y,z) to be the 
formula saying that z is the least upper bound of x and y. 

Hereafter we fix such formula 9. Write x + y = z instead of 6{x, y, z) and denote 
the neutral element in 21 given by the last axiom (which is necessarily unique) as 
0, I.e. 21 h Va:6i(0,x,x). 

For our purpose, we will mostly use -I- to define an iterated convolution product 
of a fixed probability with itself, hence commutativity is not essential; but the 
notation becomes somewhat simplified and natural under this requirement. 

We assume that there is an uncountable inaccessible cardinal k > \C\ + \A\ and 
work with a K-saturated nonstandard universe (in the sense of nonstandard analysis) 
containing a saturated elementary extension of 21 of cardinality k. Elements in the 
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nonstandard universe are referred to as internal objects and every standard object 
X is extended to an internal one denoted by *X. So the internal model *2t is the 
saturated elementary extension of 21 of cardinality k. 

Sets of cardinality < k are called small. 

Internal symbols in * C\C will not be used. 

The use of the k and the saturated model is purely for convenience and for 
consistency with the framework in [5], as Hi-saturation of the nonstandard universe 
would be sufficient for the Loeb measure construction and as the results needed from 
[5] can be rephrased for a Hi-saturated elementary extension of 21. 

We mainly work with formulas in Ca, i.e. C expanded by adding a new constant 
symbol for each element of A, and regard 21 as a i2yi-inodel in a canonical way. 
Given an £^-formula ~ fix) in free variables x of arity n, we let ip^ denote the 
set {a e A" I 2t 1= ip{a)}. (Note that is the internal set {a £ *A" \ *2l ^ fia)}, 
i.e. If '^.) Then Bq stands for the set algebra generated by the (p^, where ranges 
over £^-formulas of arity n (for its free variables). The notation stands for 
the set algebra generated by the *(p"^, still ranging over £yi-formulas of arity n. As 
Boolean algebras, Bq and B" are isomorphic. Although elements in B" are internal, 
i3" is in general an external subalgebra of *Bq. The cr-algebra generated by B"^ is 
denoted by aS". We write B and aB for B^ and aB^ respectively. 

Given an internal finitely additive probability measure fi on *Bq, the Loeb mea- 
sure construction from nonstandard analysis produces a cr-additive probability mea- 
sure on the Loeb algebra of *Bq (a certain cr-algebra extending the cr-algebra gener- 
ated by *Bq ) denoted by L{fi). Moreover, on *Bq, values of /i and L{fi) are infinitely 
close to each other. L{fi) is the unique a-additive extension w.r.t. these properties. 

Here we temporarily denote the restriction of L(/i) to aB" by 

A^" is the notation for the cr-additive probability measures °/i on crB" obtained 
in this way. is just written as Ai. Note that if is a finitely additive probability 
measure on Bq then £ Af". Conversely, if £ A^", then ^ = °(*i^), where v 

is the finitely additive probability on Bq given by v{(j)^) = ^i{*ip^). Moreover, for 
fieM"" srndX e crB", we have fi{X) = sup{Ai(r) | Y e B" AY C X} = inf{^(y) | 
Y G A F D X}, that is, fi is in agreement with both the inner and the outer 
measure of its restriction on B". Hence elements in M. correspond to the unique 
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(T-additive extension of finitely additive probability measures on ;B". fn particular, 
we only need to specify a finitely additive probability measure on either Bq or 
in order to determine a required one in A4". In general, is a proper subclass 
of cr-additive probability measures on aB"'. 

We also regard *A as topologized by basic open sets from B and when a function 
/ : — > M is measurable w.r.t. aB", we say that / is (T;B"-Borel. So / is 
cre"-Borel if f-^ [(-oo, r]] G ctS" for every r e Q. 

Given /i e A^" and crS"-Borel / we write / f{x)d^{x) for the Lebesgue integral 
of / w.r.t. fi. 

Given small C -< *2t, all the above remain valid with 21 replaced by £. Moreover, 
we use notation like Be, Mc, • ■ ■ to denote the counterparts of B, M, ... for £. 

Example 1. (i) For each a £ A, we let 5a denote the Dirac measure at a. i.e. for 

all X G aB, 5a{X) — 1 whenever a £ X and — otherwise. Similarly, for a G *A, 
we let Aq denote the internal Dirac measure at a, i.e. for all X G */Bo, Aq(X) = 1 
whenever a G X and = otherwise. 

Note that 5a £ M for every a £ A, as °Aq — 5a. 

(ii) Now suppose C = {<\ and 21 = (Q, <). Then for every infinitesimal a G *v4 
we have °Aa = 5^. □ 

Probability measures in M. are also referred to as probabilities on 21. We also 
speak of probabilities on € for other £ ^ * 21 in a similar manner. 

Intuitively, one regards a probability on 21 as the law of a random variable taking 
values in A. Hence one also regard as a set of random elements of A, in which 
the deterministic ones are identified with (5a, a G A, i.e. the >C/i-types. 

3. Definable probabilities and the convolution product 

Let A be the cr-algebra generated from sets which are small union of the ^'s, 
where the (/9(a;)'s are £ .^-formulas. By a probability measure over *2l, we mean a 
fj-additive probability measure on A such that for every small set S of the (/? "^'s, 
there is a countable subset Sq C S such that US' and U^o have the same measure. 
By [5] Lem. 6.1, given a probability measure fj, over *2l, the restriction of /i to aB^ 
belongs to A^c for any small £ ^ *2l. 
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Definition 2. (i) Let £ ^ *2l 6e small. A probability measure /i over *2l is called 
definable over € if for every C-formula ip{x,y), the mapping f : *A" — > [0, 1] given 
by f{y) = t'-iv "^('i y)) crB^^-Borel, where n is the arity of y and if> "^(-j y) denotes 
{xe *A\*%^if{x,y)}. 

(Note that such f is still aB^^-Borel even when ip{x, y) is an Cc -formula, because 
we can write >f{x, y) as 9(x, y, c), for some C-formula 9 and some c from C of arity 
TO, then f is the section of a (TB^^"^-Borel function at c, hence is aB^^-Borel.) 

(ii) The probability measure /i over *2l is said to be countably definable over € 
if for each 7i G N, there is a countably generated subalgebra Cn C crB^^, such that 
the mapping y i — > y,{{p ^(-j y)) is Cn-Borel for any C-formula ip{x, y) of arity n. □ 

We obtain from [5^ Prop. 6.4(ii) and Cor. 6.7 the following. 

Lemma 3. Suppose Tli(2t) does not have the independence property. Then every 
fj, (z Ai extends to a countably definable probability measure fi over *2t. □ 

In general, the extension /2 above is not unique. For example, if there is a type 
over Ca omitted by 2t but realized by two distinct a,b G *A, then, considering the 
Dirac measures on A, both Sa and {Sa + 5i,)/2 are countably definable probability 
measures over *2l extending their common restriction on 21. 

However if the extension is definable over 21 then there is uniqueness in the 
following sense for ilyi-formulas. 

Lemma 4. Let /ii,/i2 be probability measures over *2t extending some fi G A4. 
Suppose both fii and fi2 o,i"e definable over 21. Then for each v G A^" and Ca- 
formula ip(x,y), where n is the arity ofy, 

i^{{y G I ^iliXy) = ^i2iXy)}) = 1, where Xy = 

Proof Suppose on the contrary, G *A" \ f^iiXy) ^ fi2{Xy)}) > 0. By Def. [H 
and the assumption, {y G | tJ^iiXy) ^ fi2iXy)} G aB". So, as G M", there 
is /:A-formula e{y) such that i^ie'^) > and 9'"^ C {y G | Mi(^s) ^ ^2(^5)}- 
In particular, *2t ^ 3y9{y), hence, as 21 ^ *2l, there is a G A" n 9'^. Then 
"^(-,(2)) ^ /i2(¥' contradicting to /ii,/i2 extending /x. □ 

The following terminology deviates a bit from that used in ^ and it does not 
apply to probability measures over *2l. 



Definition 5. Suppose £ -< *2l and € is small. 

(i) A definable probability on C is some /i G A^c having an extension to a 
probability measure p. over *2t such that fl is countably definable over £. A probability 
on £ is simply called definable if the reference to £ is clear. 

(ii) If the p, is unique, we say that fi is strongly definable. 

(Hi) The set of definable probabilities on £ is denoted by T>{€). □ 

Clearly we have the following. 

Proposition 6. 6a is strongly definable, for each a ^ A. □ 

Remark 7. From Prop. we see that A embeds into I?(2l) in a canonical way 
via a I — > 6a. So we can view I?(2t) as an expansion of ^ by including "definable 
random elements" — a sort of "definable randomization" of % and view A as the 
set of deterministic elements in it. Moreover, the satisfaction relation 21 |= '^{a) 
becomes 6a{<~p ^) = 1. □ 

In [5] a class of probability measures called "smooth measures" was studied. 
These are probability measures that exclude distinct extensions on the unstable 
part, thus generalize stable types in the classical theory. By [5] Prop. 6.4(iii) and 
and Cor. 6.7, we have the following. 

Lemma 8. (i) Each smooth probability on 2t is strongly definable. 

(ii) In particular, if Th(2t) is stable, all probabilities on 2t are strongly definable, 
soM = V{^). □ 

In the absence of the independence property, every probability on 21 extends to 
a smooth one by [5] Thm. 3.16(ii). Therefore the following holds. 

Lemma 9. Suppose Th(2l) does not have the independence property. Let fi G Ai, 
then for some small £ with 21 £ -< *2l, fi has a extension to a strongly definable 
probability on £. □ 

If 21 is o-minimal, then its theory does not have the independence property. 
Hence the above lemmas are applicable to o-minimal models. In these models, a 
certain linear order is definable and every Z^^i-formula ip{x) is equivalent to a fi- 
nite combination of intervals. Important examples include £H and its expansions 
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equipped with the exponential function or restricted analytic functions. In particu- 
lar, the law of a real-valued random variable in the classical sense is always strongly 
definable. Therefore our setting here is a generalization of that for classical sto- 
chastic analysis. 

It is worth mentioning that p-adic fields are not o-minimal but does not have 
the independence property either. 

But we do not know whether the absence of the independence property or o- 
minimality or elimination of quantifiers imply that every /z G is always strongly 
definable, or even just definable. 

A useful fact is the following that P(2l) and its subclass of strongly definable 
probabilities are closed under convex combinations. The verification is straight- 
forward. 

Proposition 10. Let /i and v he (strongly) definable probabilities on 21. Let r S 
[0, 1]. Then the probability rfi + (I — r)j/ is also a (strongly) definable probability on 



Theorem 11. Let /i, ly be probability measures over *2t so that both pL and v are 
countably definable over some small £ ^ *2t. Then the mapping 



extends uniquely to a probability measure over *2l which is countably definable over 



We denote this measure by j-i^v. 

Proof. First, by the note in Def. [21 the function y i — > G *A | *2l |= <y9(x + ?;)}) 

is ^-Borel, hence the above Lebesgue integral, therefore the ^, is well-defined. 
Clearly ^ forms a finitely additive probability measure on A. For example. Let 



So, by [5J Lem. 6.2, ^ extends uniquely to probability measure i^' over *2l. 



21. 



□ 




(y9i(a;), 1^2(2:) be £*^-formulas such that ipi^ n Lp2^ = 0, then 





For definable probabilities, the probability measure given above is unique on aB 
in the following sense. 

Proposition 12. Let £ P(2t). Let /i and v respectively extend to probability 
measures /^i,/i2 cind vi,i'2 over *2l which are countably definable over 21. 
Then pLi^vi and ^2'ki'2 (o-s given by Thm. [77]] coincide on aB. 

Proof. Let (p{x) be any £yi-forniula. Then 

fi2{^'^{-+y))di^2{y) ^ J ^i2{^''^{-+y))du{y)^ J fii{'f'^{-+y))du{y) ^ J iii{^'^{-+y))dvi{y), 

where the first equality follows from the mapping y i — > ^2(95 '^(' + 2/)) being aB- 
Borel and extending v, the second one follows from Lem. |4] and the third one 
follows from vi extending v. 

Hence niirvi and i22-ki^2 coincide on aB. □ 

Now we define the convolution of definable probabilities on 2t. 

Definition 13. (i) Let /i, G P(2l). Let ft, 9 be any extensions of pL^v respectively 
which are probability measures over *2l and countably definable over 21. Then the 
convolution product of n and v is the restriction of the fi^v given by Thm. [77] to 
aB. 

(ii) By Prop. [U] this convolution product is unique. This uniquely defined prob- 
ability measure on 21 is denoted by fi-kv. □ 

By Thm. [TT] we also have the following. 

Corollary 14. Let fi,iy e P(2t). 

(i) (^★i^) G P(2l). 

(ii) Moreover, if fi, v respectively extend to probability measures p., P over *2l 
which are countably definable over 21, then pa^ v extends to pL^i>, a probability 
measures over *2t which is countably definable over 21. □ 

Remark 15. (i) If the above pb^v are strongly definable, is fx-kv strongly definable? 

(ii) //Th(2l) does not have the independence property, then by Lem. [9] and k > 
\C\ + \A\ being an uncountable inaccessible cardinal, there is a small £ such that 
21 ^ £ ^ *2l and every probability on 21 extends to a strongly definable one on £. By 
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restricting the convolution product back to aB one can define a convolution product 
for the whole M., although this need not be the only possible one. 

(Hi) If one of the probability measures fi,v on% extends to a smooth probability 
measure over then ^-kv = v -k ji holds by ^ Thm. 6.15 and the commutativity 
of+. 

(iv) Given /i G and a G A, we have {ji -k 6a){^ — l^if + i-^- 
l-j, k 6a is the probability measure given by the translation of fj, by a. In particular, 

(v) By using the Dirac measure at a on A, Sa extends to a probability measure 
over *2l which is countably definable over% and is smooth, so it follows from (Hi) 

that ^-k 6a — 6ak ^. □ 

Since our attention is more on the iterated convolution of a single definable 
probability on 21 we are not so concerned with defining a convolution product 
for the whole A4 nor with commutativity. However, in our case we do have the 
convenience of associativity of the convolution product. 

Proposition 16. Let fi,iy, X G 'D{^). Then {^i -k v) -k X = fi k: [v -k X) . 

Proof. Let ^, v, X respectively extend to /2, v, A, some probability measures over *2t 
which are countably definable over 21. 

We first note that for any ^-^-formula 6i(a;), (z?*A) (61 *^(-)) = [i? x A] *^(- + •)) , 
where [D x A] denotes the nonforking product in [S^ . 

Therefore, for any crS-Borel function / : *A^^"' — > M and ai, . . . ,a„ e *A, we 
have 

j f{w, ai, . . . , an)d{D^X){vu) = J f{y + z,ai, . . . , a„)d[j> x X]{y, z). 

So 

f{w, ai, . . . , an)d{D^X){w) = I I f{y + z,ai, . . . , an)dD{y)dX{z), 



by [S] Lem. 6.13. 

Now let ip{x) be an CA-iormula. By Cor. I14i D-k^X is a probability measure over 
*2l, countably definable over 2t and extending i^-kX. Similarly, p,i(i> is a probability 
measure over *2l, countably definable over 21 and extending ^kv. So from what was 
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just shown, we have: 

(/i*(:.*A))((^*^(.)) - / fl{ip'^{-+w))d{Di,~X)iw)^ II fji{^'^{- + {y + z)))dv{y)d\{z) 

+V) + z))dv{y)dX{z) = I (/2*i>)(^*-4(. ^ ^))^^(^) 

Therefore {^-k v) -k \ — ^-k {v -k X). □ 

Notice the use of the associativity of + in the above proof. The following useful 
fact is easy to check. 

Proposition 17. Let fi,iy,X G 2?(2l) and r e [0, 1]. Then (r/x + (1 - r)iy) ★ A = 
r(^* A) + (1 - r)(z^* A). □ 

Definition 18. Let /i G I?(2t). For n G N+ we write fjL^* for the convolution power 
fj,* ■ ■ ■ -k ^ . When n ~ 0, fi"'* is defined to be 6q. Note that, by Prop. \16[ /i"* is 

n times 

unambiguously defined. 

If fi is a countably definable probability measure over *2l, we define /i"* simi- 
larly. □ 

The following generalizes part of Prop.fTUl by showing that 2?(2l) is closed under 
infinite convex combinations. As a consequence, T>{^) supports some functional 
calculus, i.e. some "analytic" functions are definable. 

Theorem 19. Suppose a„ > 0, n G N, such that J2^=o ~ 1- 
Let fin G P(2l),n G N. Then (E,T=o««A'n) e P(2t). 
In particular, X^J^Lo '^"/^"*) ^ 2^(21) for any fi G 

Proof. First, it is clear that X^^o '^"/^") 

For each ri G N, let /i„ extend to some /!„ which is a probability measure over *2t 
and is countably definable over 21. It is easy to see that X^J^o '^npn is a probability 
measure over *2t. 

Let y have arity m. By definition, since the /i„'s are countably definable over 21, 
there is a countably generated subalgebra Cm C ctS™ such that for all £-formula 
ip{x,y) and n G N, the mappings y i — > /in(i^ '^('i?/)) ^-re Cm-Borel. Then, as 

oo m 

(^^anp.n^{(p ^(-^y)) = sup (^^anp.n^{(p ^ {■ , V)) , 
n=0 ""^^ n=0 
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y I — > ^^=o'^np'n{'P '^{■,y)) is the supremum of a countable family of Cm-Borel 
functions. 

Hence y i — > J2'i^=o^nP'n{'P ^(-jy)) is a Cm-Borel function. 

Therefore J2'^=o ^np'n is a probability measure over *2l which is countably de- 
finable over 2t. 

Since Y^^=o OnMn extends Y^^=o '^nfJ-n, we conclude that ^ X^J^o ^"Mn 

□ 

Remark 20. When dealing with an infinite convex combination of iterated con- 
volution powers of some fi G 2?(2l); the Borel functions in the above proof can be 
represented by integrals. Let p, be an extension of ji which is a probability measure 
over *2l and is countably definable over 21. Then 

oo oo 

( J2 a-M"*) *^(-' y)) = E ^)) 

oo „ 

/oo 
[ ^ a„/2("-i)*((p*^(- -f X, y))] dp{x) + aoSo{(p'^{:,y)), 

&j/ the Lebesgue monotone convergence theorem. □ 

We now introduce the notion of convolution exponential, in order to obtain 
infinitely divisible definable probabilities on 21 in the next section. 

Definition 21. Let fi G 2?(2l), r G [0, oo) then we define the convolution exponential 
of r/i as 

oo „ 

(So it gives Sq when r — 0.) 

If ^ is a countably definable probability measure over *2t, we define e'"'-^*"^'' 
similarly. □ 

As a consequence of Thm. [T21 we have the following. 

Corollary 22. Let ^ G X'(2l), r G [0, oo), then e''(^*-i) G P(2l). 

Similarly, if fi is a countably definable probability measure over *2l, e''^''*"^-' is 
a countably definable probability measure over *2l. □ 
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4. Infinitely divisible probabilities and Levy processes 

In the this section, we will work with probabilities from ^(Sl) and the convolution 
product * defined on it. By Cor.[T4l I?(2l) it is closed under * and, by Thm.[T9l it is 
closed under infinite convex combinations, including the convolution exponentials. 
Moreover, I?(2l) includes A in the sense that 6a G I?(2t) for every a ^ A. 

From now on, 2?(2l), *, as well as the elements of the underlying aB are considered 
to be standard objects and, for the purpose of Loeb measure construction, we shall 
adopt an Hi-saturated nonstandard universe possibly different from the one used 
in the previous sections. However, we continue to use *X to denote nonstandard 
extensions in this nonstandard universe. In particular, *2l refers to the Ni-saturated 
elementary extension of 21 in this nonstandard universe, not the one used in previous 
sections. 

Let v be an internal probability on In particular, v is an internal finitely 
additive probability measure on *aB. So its Loeb measure L{i>) is a cr-additive 
probability measure on L{*aB), the Loeb algebra of *aB. Note that aB embeds 
canonically as a subalgebra of L{*aB) and we let "i/ denote the restriction of L{i') 
to (jB. Note also that for /i G Al, = fi. But, in general, needs not be an 

element of A4. 

It seems necessary to expand ^(St) to a larger class of probability measures in 
order to make more random elements available for constructing Levy processes and 
for simplifying the proof of some properties about 2?(2l) itself. 

Definition 23. (i) For ^1,1/2 G *X'(2l), we write vi « V2 if vi{X) k. V2{X) for all 
X G *aB. We also use expressions like vi < V2 and vi ^ i>2 in a similar manner. 

(ii) A a-additive probability measure fx on L{*aB) is called L-definable if fj, ~ 
L{v) for some v G *P(2l). 

(Hi) We write r(*2t) ~ {L(iy) \ v G *2?(2l)}, i.e. the L-definable probability 
measures on L{*aB). 

(iv) On r(*2l), the convolution product is defined by L{vi) -k L{v2) = L{vi -kV2). 

(Note the multiple usages of the symbol -k : on X'(2t), *2?(2t) or r(*2l), depending 
on the context.) □ 

Observe that each G I?(2l) extends uniquely to L{* G r(*2l). 
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Proposition 24. (i) The convolution product given in Def. \23f iv) is well-defined. 



(ii) Given a series of the form in Thm. HM we have LI X^^^o ^nlJ-n ) = X^^^o o,nL(pn) 



for any fin G *P(2t),n E N. In particular, L(e''(''*"^^) = e''^-''^'^^*"^^ for any 
fj. e *P(2t) anrf r e [0,oo). 

(iii) r(*2l) is closed under the convolution product and infinite convex combina- 
tions as in Thm. [TM (Hence is closed under convolution exponentials.) Moreover, 
*2t embeds into r(*2t) via a i — > 6a, where a G *A. 

Proof, (i): Let /ii, /i2, i^i, G *I?(2l), such that = L{vi) and L{p2) = i(!^2)- 

Then by the Loeb construction, /ii rs z^i and /i2 ~ z^2- 

Let X e *aB. Then by ^i, fi2, i^i, 1^2 £ *-^, some F G *B can be chosen such 
that 

(^1 ★/^2)(^) « (a*i *A*2)(i^) and {i^i * iy2){X) Ki {i>^ -k v2)iY). 

By the transfer principle from nonstandard analysis, Y is represented by some *Ca- 
formula ip as the set (p'~''{-) for some internal £ 21. (In fact £ has the form *2l if 
we let 21 denote the *2l used in previous sections.) Then 



ber.) The last equality follows from the Loeb measure construction. 

Likewise, {i^i * i'2){X) ~ f L{ui)(^ip'^ {■ -\- x))dL{v2){x), hence {fii * fi2){X) w 
{I'l -k i/2){X). Since this holds for all X G *(tB, we have (/ii ★ /i2) ~ {1^1 * V2) and 
conclude that * ^2) = L{vi -k V2). 

(ii) : By a proof similar to that of Thm. [111 Note that X^J^Lo "^"/^n refers to an 
internal series extending the given one. 

(iii) is clear from the corresponding properties of *P(2l) and the Loeb measure 
construction and (ii). □ 





because the integrand /ii((y5'^(- + a;)) is S'-integrable, so it lifts the Loeb integrable 
function st jii [(fi^ {■ + a;)) . (Here st denotes the standard part of a hyperreal num- 



Remark 25. In a way, the relation between *2t and r(*2l) is like that between 21 
and 2?(2l), so we should view r(*2t) as the set of definable random elements from 
*2l. □ 
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We will study the infinite divisibility of a probability from P(2t) or from r(*2l) 
and the Levy process corresponding to such probability. As remarked before, this 
setting generalizes the setting for classical stochastic analysis, which corresponds 
to the case 2t = 9^. Results about classical stochastic analysis can be found in [3], 
[To] and [11] , while nonstandard treatment of them can be found in [1] , [7] and [9] . 

Definition 26. Let fj, G P(2l). /i is said to be infinitely divisible if for every n £N 
there is v ^ I?(2t) such that i>"* ~ fi. 

This is also similarly defined for /i G r(*2l). 

To emphasize, we say "infinitely divisible in ^(Sl) " or "infinitely divisible in 

r(*2i)". □ 

In the case 21 = £H, classical result shows that the above v is unique if it exists. 
However the uniqueness depends at least on the underlying semigroup structure of 
21. For example, if the underlying semigroup is [0, 1) with x + y defined to be the 
fractional part of the usual addition, then for fi — 5o the above v would not be 
unique. 

Proposition 27. The following are equivalent for any ^ G *2?(2l) : 

(i) is infinitely divisible in r(*2t). 

(ii) For all small infinite N G *N, there is u ^ *2?(2t) such that ^ « i/^* . 

(iii) For some infinite N G *N, there is v £ *2?(2l) such that /i w v^'* . 

Proof (i) => (ii): For each n G N, let /i„ G *P(2l) such that L{fi) = L{pnT*- By 
Dcf . I^HTiv) and Prop.lMTi). = L(/i„"*), hence /x « /in"* by the Loeb measure 
construction. 

Therefore, it holds for each n G N that VX G *crB{\n{X) - /i„"*(X)| < n"!). 
By Hi-saturation, extend {fJ.n}neN to an internal sequence. Then it holds for all 
small enough N e *N that VX G *aB{\fi{X) - fiN^*{X)\ < N-^). 

Therefore, for any small enough infinite N G *N, if we let = /ijv , then /i w i/^*. 

(ii) =4> (iii): By Hi-saturation, there are arbitrarily small infinite factorials. 

(iii) ^ (i): Suppose « i/^-*, where TV G *N is infinite and i' G *P(2l). For 
each n G N, let fi„ = Then fj. « ^H*, hence L{fi) = L{^ill*) = £(/*„)"* by 
Def. [23i;iv) and Prop. EKi) again. □ 

Now we define a Levy process along a timeline. 
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Definition 28. By a timeline, we mean an interval I with endpoints from a linearly 
ordered semigroup {S, +, <) such that the left endpoint of I is denoted by and the 
right one by 1. 

(Note that the symbols + and are used both for this linearly ordered semigroup 
and for the semigroup of 21, but the intended meaning should be clear from the 
context.) 

Let jjL G I?(2l) be infinitely divisible. By a Levy process corresponding to n w.r.t. 
/ we mean a mapping X : I — > I? (21) such that 

X{0) = 6o,X{l) = II and X{s + 1) = X{s) X{t) for all s,t,s + teL 

A Levy process corresponding an infinitely divisible fj, G r(*2l) w.r.t. I is defined 
similarly. □ 

The Levy process above can be regarded as an evolution along a "straight line 
segment of probabilities" from the deterministic element to the random element 
/U. Intuitively, one expects that in general unless the geometry is complicated, there 
should be only one unique "straight line segment" joining 6o and /U. Of course this 
depends on the uniqueness of the n*^ root of the convolution product. 

Main examples of the / considered are the real interval [0, 1] from fH, or [0, 1] flQ 
from (Q, +, •, <, 0, 1) or the hyperfinite timeline of the form {O, N''^, 27V-\ • • • , NN''^ = 
1}, identifiable with {0, 1, 2, • • • , N}, from (*N, +, •, <, 0, 1) for some infinite N G* 
N. 

Remark 29. Given a Levy process w.r.t. / of the above types, X{t) is infinitely 
divisible for every t G I, since for any n G N^, by repeated applications of the 
additive condition to X(ji~^t), we have X{n~^t)"* = X{t). □ 

If X is a Levy process w.r.t. [0, 1], the restriction of X to [0, 1] fl Q is of course 
also a Levy process. But converting a Levy process w.r.t. an infinite hyperfinite 
timeline to a Levy process w.r.t. [0, 1] would require some continuity conditions. 
However it is simple to get a Levy process in r(*2l) w.r.t. a hyperfinite timeline. 

Proposition 30. Let fj, G r(*2l) be infinitely divisible. 

(i) For some infinite N €*N there exists a Levy process corresponding to /x w.r.t. 
the hyperfinite timeline I = {nN~^ | n = 0, 1, • • • , 

(ii) There exists a Levy process corresponding to fj, w.r.t. / = Q fl [0, 1]. 
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Proof, (i): By Prop. ED^ii), fi = L{v^*) for some infinite iV £ *N and v e *P(2t). 
Then we simply define X : I — > r(*a) by X{nN-^) = L{u''*),n = 0, 1, • ■ • , TV. 

(ii): By Prop.[27i;iii). fJ, = L{v^-*) for some infinite iV e *N and e *V{%). Tlien 
we define the Levy process X : I — > V{*%) by letting X{nm-'^) = , 
where n, m e N with nm~i e Qn [0, 1]. □ 

Remark 31. In the case 21 = one can show for example by ^9] that the definition 
of the Levy processes above does not depend on a particular choice of the v in 
the above proof. But we don't know how to identify general 21 that satisfies this 
property. □ 

The more difficult problem is to find Levy processes in P(2l) w.r.t. the continuous 
timeline I — [0, 1]. 

Proposition 32. Let ji E P(2l) and r G *M have standard part s > 0. Then 

In particular, °(e'-(>*-i)) e X'(2t). 

Proof By r being finite, e-( « TTT « ^^=0 TTT >"* any 

infinite K e*'N. 

Hence L(e''(>*-i)) coincide with e"(^*-i) on ctS, i.e. "(e'-O*-!)) = e^^^^^i). 

□ 

We need the following little fact before proving the next theorem. 

Proposition 33. Let ii,v E *'D(2l). Then ^Sv implies /i w v. 

Proof. Suppose /i ~ and there is 5 G *ijB such that ^ '^('S')- Consider the 
complement S'^ , then IJ.{S^) = 1 — ^ 1 ^ ^('5) = v{S^), a contradiction. □ 

Theorem 34. Let fi G *X'(2t) and let r G *[0, oo). Then for all large enough K e*N 
there is A G *P(2l) such that e'"^''*"^) w A^*. Moreover, we can take 

\= {l + rK-^y^So+rK-'^{l + rK^^y^H, i.e. {l + rK-^y\So + rK'^ . 

Proof. Let K E *N and define A as above. By transferring Prop. [TOl as a convex 
combination, A G *X'(2l). Then by transferring Prop. [T71 

n=0 ^ ^ 
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Note that 



K\ 1 Kl 



ji-i 



L - TT ( - — 1 1 — 



Note also that for all large enough if e *N we have e''(l + rK^^^ ^ 
Moreover, for such K we have 

K 



n=0 

Hence it follows that for large enough if e *N we have 

K 



~ ^ n! 

n=0 

the result now follows from Proposition [33l □ 

By Prop. [TTTiiiV Thm. [Ml and Prop. I^^ ii). we immediately have the following. 

Corollary 35. Let ^ e *P(2l) and let r e *[0,oo). Then e'~(^(^)^-i) is infinitely 
divisible in r(*2l). □ 

Remark 36. In the proof of Thm. \^^ the size of the K depends on the r only. So, if 
the X^* is given first, one can identify some r and obtain /i so that e*"'^*^^) « A^*. 
Therefore this would have shown that in r(*2t) infinite divisibility is equivalent to 
being a convolution exponential. However, such ^ would be a (signed) real-valued 
measure instead of a probability measure. Perhaps, this is enough justification to 
extend the framework here to more general measures. □ 

The following gives more information about convolution exponentials in r(*2t). 

Corollary 37. (i) Let fi e *P(2t) and r, s £ *[0, oo). Then 

gr(L(M)*-l) ^gS(L(M)*-l) ^ g(r+s)(L(M)*-l)^ 

(ii) Convolution exponentials in r(*2l) are always infinitely divisible and have n*"^ 
roots given by convolution exponentials: Let fi £ *I?(2l), r € *[0, oo) and n G N+. 
Then 
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Proof, (i): Apply Thm. [Ml to e(''+'')('"*-i) and choose large enough K ^ *N such 
that £ = rsK^^ w 0. Then 



r + s + e\ /. r + s e 



2* 



The arrival of the first term following the second last « is justified by e « and 
(l + ^-^y^ ~ e''+*, while the second term is justified by the following estimate: 



Let X e *<7B, then 

K* / , \ K* 



■ n=l 

Now by Prop. [MTiVfii). we have 

(ii): By first applying (i) with both r, s replaced by rn~^, then applying (i) again 

with r, s replaced by rn~^ , 2rn~^ , , after iterating (n— 1) times, the conclusion 

follows. □ 

Now an almost identical result for convolution exponentials in I?(2l) : 
Corollary 38. (i) Let fi G and r, s e [0, oo). Then 

(ii) Convolution exponentials in are always infinitely divisible and have 

71*'' roots given by convolution exponentials: Let fi E 2^(21), r G [0, oo) and n G N". 
Then 

Proof, (i): Apply the same computation in the proof of Cor. [571 1) for */i, we have 
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Let X G aB, then, by transfer, 

(e''(^*^i)*e''^''*^-^^) (X) — [e^^' '^*^^''i^e'^^' ^*~^''){* X) « t^*-'^) {* X) = e^^^^^'^^* 

Hence {e''^^'*-'^) -k e'^^'*-^''>){X) = e(''+'^)(^*-i) (X) for all X G crS, i.e. e'~(^*-i) 

gS(Ai^-l) _ g(r+s)(Ai^-l)^ 

(ii) follows by iterating (i), as in the proof of Cor. ISTT ii). □ 
The following gives the "mode" of continuity in the convolution powers. 

Corollary 39. Let X and K as in Thm. Let L G *N such that rLK^^ « 0. 
Then A(^+'^)* w A^^. 

Proof. For notational convenience, we extend our definitions slightly and use real- 
valued measures. First note that 

L-l 
n=0 

Since A - 5o = (l + rR-^y^R-^^i - Sq), we have VX G *aB(^\X^'^+^^*{X) - 
A^*(X)| < 2rLK-^ « 0^ . i.e. X(^+^')* « A^*. □ 

Now we are ready to show that, in both the case of r(*2t) and the case of X'(2t), 
Levy process w.r.t. the continuous timeline / — [0, 1] always exists for a convolution 
exponential. The question of uniqueness is still open for the general case other than 
d\. 

Theorem 40. Let I = [0,1], [0,1] n Q or any hyperfinite timeline of the form 
{0,N-\2N-^,--- where N e*N. 

(i) Let II G r(*2l) be a convolution exponential. Then there exists a Levy process 
X -.1 — > r(*2l) such that X{1) = II. 

(ii) Let II G I?(2l) be a convolution exponential. Then there exists a Levy process 
X : L > D(2l) such that X{1) = ^. 

Proof, (i): For some G *X>(21) and r G [0, oo), we have ^ = griLii')*-!) _ 
Then, for / ^ [0,1], define X : L — > r(*a) by X{t) = e*r-{L{^)*~i) 

Cor. \S7\i). X is a Levy process. 

The restriction of X to [0, 1] n Q is clearly also a Levy process. 

For/= {0,N-\2N-\--- , l}, we define X(niV-i) as L(e"^"'''(''*-i)) and use 

Cor. [3Wi) again. 
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(ii): We write /i = e''^'^^^^) for some V G and r £ [0, cx)). Then define X as 

in the proof of (i) but apply Cor. ISST i). 

Inthecase/= {0, 7V-i, 2A^-\ • ■ • , l}, we define X(nA^-i) as ° (e"^"'''(''^^-i)) , 
which is in P(2l), by Prop. [32 □ 

Now we formulate a weak converse of Cor. lSSf ii) as an important property which 
basically says that infinitely divisible probabilities are in the closure of exponen- 
tial ones in a certain sense. This property holds for the case of 9^. Combined 
with Fourier analysis, the celebrated Levy-Khintchine formula is a corollary to this 
property. 

Definition 41. We say that 2t has the Levy-Khintchine property if for every /i G 
P(2l), fi is infinitely divisible iff n — ° (^e'"'-''*^^-') for some v G *P(2t) and r G 
*[0,oo). □ 

Remark 42. Suppose 21 has the Levy-Khintchine property. Then for each infinitely 
divisible /i G 2^(21), by Thm. \4-(^ i), there is a Levy process X in r(*2l) so that the 
restriction of X{\) to aB is fi. However, X{1) needs not be L{* pi) in general. □ 

We isolate the following property for an infinitely divisible probability which 
requires the n'^ roots to be concentrate sufficiently near 0. 

Definition 43. We say that fi G I?(2l) has the concentration property if there exists 
X G *2?(2l), r G *[0, oo) and infinite K e*^ such that 

(i) e'-{l + rK-^y'^ « 1; 

(ii) VX G *aB{\*fi{X) - X^*{X)\ < K-^); 

(in) X{{0})> {l + rK-^y^. □ 
Note that by Prop. [571 for the above /i, L{* ji) has to be infinitely divisible in 

r(*2i). 

From classical results such as those in |lT] one can show that every infinitely 
divisible probability on £H has the concentration property. 
Our main interest of the property is the following: 



Theorem 44. Suppose that every infinitely divisible probability in X'(2t) has the 
concentration property. Then 21 has the Levy-Khintchine property. 
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Proof. Let /i e I?(2l) be infinitely divisible, with the A, K and r given as in Def. |43l 
For some internal £ ^ 21, each X E *B has the form f'^i-) for some *£A-formula 
(p. To define an internal probability // on *2l, for X = let 

(1 + Kr-^)X{X) - Kr-^, if *2l h ¥^(0), ie. if G X 

(l + Kr-'^)\{X), otherwise. 
Using the lower bound for A ({0}) , it is easy to check that v extends uniquely to 
an internal probability on *2l and belongs to *X'(2t). We still call the extension as 
V. Now we can re-write A as the convex combination 

A = {I + rK-^y^ {6o + rR-^v) . 

Then similar to the proof of Thm. [34] 

V « A-^"^ < e^'' y — z/"* « e'^''*~^\ 
~ ^ to! 

and hence > « e'^''*-^'^ and so ^ = = ° (e''(''*-i)) . □ 

Remark 45. (^zj W^e conjecture that p-adic fields have the Levy-Khintchine prop- 
erty. 

(ii) In our framework, we do not exclude the possibility that the semigroup from 
21 could be compatible with the semigroup that indexes a Levy process. It may 
be worthwhile to formulate Levy processes which are definable processes in some 
sense. □ 
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